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I— I ' Abstract 

u 

■ The paper formulates the concept of persistence of excitation for discrete-time 

linear switched systems, and provides sufficient conditions for an input signal to be 
persistently exciting. Persistence of excitation is formulated as a property of the input 
signal, and it is not tied to any specific identification algorithm. The results of the 
paper rely on realization theory and on the notion of Markov-parameters for linear 
switched systems. 

> 

^ ■ 1 Introduction 

T— I 

. The paper formulates the concept of persistence of excitation for discrete-time linear 

^ switched systems (abbreviated by DTLSSs). DTLSSs are one of the simplest and best 

studied classes of hybrid systems, [23]. A DTLSS is a discrete-time switched system, such 
that the continuous sub-system associated with each discrete state is linear. The switching 
signal is viewed as an external input, and all linear systems live on the same input-output- 
and state-space. 

We define persistence of excitation for input signals. More precisely, we will call an 
input signal persistently exciting for an input-output map, if the response of the input- 
output map to that particular input determines the input-output map uniquely. In other 
words, the knowledge of the output response to a persistently exciting input should be 
sufficient to predict the response to any input. 

Persistence of excitation is essential for system identification and adaptive control. 
Normally, in system identification the system of interest is tested only for one input se- 
quence. One of the reason for this is that our notion of the system entails a fixed initial 
state. However, any experiment changes that particular initial state and it is in general 
not clear how to reset the system to a particular initial state. The objective is to find a 
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system model based on the response to the chosen input. However, the knowledge of a 
model of the system immediately implies that the response of the system to any input is 
known. Hence, intuitively it is clear that persistence of excitation of the input signal is a 
prerequisite for a successful identification of a model. 

Note that persistence of excitation is a joint property of the input and of the input- 
output map. That is, a particular input might be persistently exciting for a particular 
system and might fail to be persistently exciting for another system. In fact, it is not a 
priori clear if any system admits a persistently exciting input. This calls for investigating 
classes of inputs which are persistently exciting for some broad classes of systems. 

In the existing literature, persistence of excitation is often defined as a specific property 
of the measurements which is sufficient for the correctness of some identification algo- 
rithm. In contrast, in this paper we propose a definition of persistence of excitation which 
is necessary for the correctness of any identification algorithm. Obviously, the two 
approaches are complementary. In fact, we hope that the results of this paper can serve 
as a starting point to derive persistence of excitation conditions for specific identification 
algorithms. 

Contribution of the paper We define persistence of excitation for finite input 
sequences and persistence of excitation for infinite input sequences. 

We show that for every input-output map which is realizable by a reversible DTLSS, 
there exists a finite input sequence which is persistently exciting for that particular input- 
output map. A reversible DTLSS is a DTLSS continuous dynamics of which is invertible. 
Such systems arise naturally by sampling continuous-time systems. In addition, we define 
the class of reversible input-output maps and show that there is a finite input sequence 
which is persistently exciting for all the input-output maps of that class. Moreover, we 
present a procedure for constructing such an input sequence. 

We show that there exists a class of infinite input sequences which are persistently 
exciting for all the input-output maps which are realizable by a stable DTLSS. The condi- 
tions which the input sequence must satisfy is that each subsequence occurs there infinitely 
often (i.e. the switching signal is rich enough) and that the continuous input is a colored 
noise. Hence, this result is consistent with the classical result for linear systems. 

It might be appealing to interpret the conditions above as ones which ensure that one 
stays in every discrete mode long enough and the continuous input is persistently exciting 
in the classical sense. One could then try to identify the linear subsystems separately 
and merge the results. Unfortunately, such an interpretation is in general incorrect. The 
reason for this is that there exists a broad class of input-output maps which can be realized 
by a linear switched system but not by a switched system whose linear subsystems are 
minimal, |20j . The above scheme obviously would not work for such systems. In fact, for 
such systems one has to test the system's response not only for each discrete mode, but 

""^In fact, we also propose a specific algoritlim for the correctness of which persistence of excitation is 
sufficient, but we do not claim this is true for all identification algorithms. 
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for each combination of discrete modes. 

The main idea behind the definition of persistence of excitation and the subsequent 
results is as follows. From realization theory [2D] we know that the knowledge of (finitely 
many) Markov-parameters of the input-output map is sufficient for computing a DTLSS 
realization of that map. Hence, if the response of the input-output map to a particular 
input allows us to compute the necessary Markov-parameters, then we can compute a 
DTLSS representation of that map. This can serve as a definition of persistence of ex- 
citation. We call a input sequence persistently exciting, if the Markov-parameters of the 
input-output map can be computed from the response of the map to that input. We call an 
infinite sequence input persistently exciting, if from a large enough finite initial part of the 
response one can compute an arbitrarily precise approximation of the Markov-parameters. 
Since the realization algorithm for DTLSS is continuous in the Markov-parameters, it 
means that a persistently exciting infinite input sequence allows the computation of an 
arbitrarily precise approximation of a DTLSS realizing the input-output map. 

Motivation of the system class The class of DTLSSs is the simplest and perhaps 
the best studied class of hybrid systems. In addition to its practical relevance, it also serves 
as a convenient starting point for theoretical investigations. In particular, any piecewise- 
affine hybrid system can be viewed as a feedback interconnection of a DTLSS with an 
event generating device. Hence, identification of a piecewise-affine system is related to the 
problem of closed-loop identification of a DTLSS. For the latter, it is indispensable to have 
a good notion of persistence of excitation. For this reason, we believe that the results of 
the paper will be relevant not only for identification of DTLSSs, but also for identification 
of piecewise-affine hybrid systems with autonomous switching. 

Related work Identification of hybrid systems is an active research area, with sev- 
eral significant contributions [Ml[ia[9l[ia[I71[25l[l2l[5l[l3l[IIl[9l[a[2l[23 
While enormous progress was made in terms of efficient identification algorithms, the 
fundamental theoretical limitations and properties of these algorithms are still only par- 
tially understood. Persistence of excitation of hybrid systems were already addressed in 
\26 \ \25 \ [27 1 1^4 1 110] . However, the conditions of those papers are more method-specific and 
their approach is quite different from the one we propose. For linear systems, persistence 
of excitation has thouroughly been investigated, see for example |14tl28] and the references 
therein. 

Outline of the paper ^presents the formal definition of DTLSSs and it formulates 
the major system-theoretic concepts for this system class. ?}3] presents a brief overview of 
realization theory for DTLSSs. ^presents the main contribution of the paper. 

Notation Denote by N the set of natural numbers including 0. The notation described 
below is standard in automata theory, see [8l 3]. Consider a set X which will be called 
the alphabet. Denote by X* the set of finite sequences of elements of X. Finite sequences 
of elements of X are referred to as strings or words over X. Each non-empty word w is 
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of the form w = aia2 • • • flfc ^or some ai, 02, . . . ^a^ € X. The element Oj is caUed the ith 
letter of w, ioi i = 1, ... ,k and k is cahed the length of w. We denote by e the empty 
sequence (word). The length of word w is denoted by \w\; note that |e| = 0. We denote by 
the set of non-empty words, i.e. = X* \ {e}. We denote by wv the concatenation 
of word w E X* with v G X* . For each j = 1, . . . , m, is the jth unit vector of M™", i.e. 
Cj = ((^ij, • • • , (^nj)) is the Kronecker symbol. 

2 Linear switched systems 

In this section we present the formal definition of DTLSSs along with a number of relevant 
system-theoretic concepts for DTLSSs . 

Definition 1. Recall from 119] that a discrete-time linear switched system (abbreviated by 
DTLSS), is a discrete-time control system of the form 



Here Q = {1, . . . , D} is the finite set of discrete modes, D is a positive integer, qt Q is 
the switching signal, ut E M is the continuous input, yt G is the output and Aq G M"^", 
Bq G M"^™, Cq G M^^" are the matrices of the linear system in mode q & Q. 

Throughout the section, S denotes a DTLSS of the form (Cp. The inputs of S are 
the continuous inputs {ut}^Q and the switching signal {qt}t^Q- The state of the system 
at time t is xt- Note that any switching signal is admissible and that the initial state is 
assumed to be zero. We use the following notation for the inputs of S. 

Notation 1 (Hybrid inputs). Denote U = Q xW^. 

We denote by U* (resp. U^) the set of all finite (resp. non-empty and finite) sequences 
of elements oiU. A sequence 



describes the scenario, when the discrete mode qi and the continuous input Ui are fed to 
S at time i, for i = 0, . . . ,t. 

Definition 2 (State and output). Consider a state Xmit G M". For any w G of the 
form denote by XY,{xinit-,w) the state of S at time t + \, and denote by yT.{xinit-,w) 
the output o/S at time t, i/S is started from Xinit and the inputs {tij}*=o ^'^'^ discrete 
modes {qi}\^Q are fed to the system. 

That is, XY,{xinii,w) is defined recursively as follows; xj^ixinu-, ^) — Xinu^ and ii vj — 




xt+i = Aq^xt + Bq^ut and xq = 

yt = Cq^Xt. 



(1) 



w = 



{qo,Uo) ■ ■ ■ {qt,ut) G , t > 
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v{q,u) for some (g, u) v &U*, then 



XE{Xinit,w) = AqXY:{Xinit,v) + BgU. 

If t/; S and ^i; = v{q, u), {q, u) v &U*, then 

yT.{Xinit,w) = CqXY.{xinit,v). 

Definition 3 (Input-output map). The map : Vif E : yj:{w) = y{xQ,w), 

is called the input-output map ofTi. 

That is, the input-output map of S maps each sequence w £ U'^ to the output generated 
by E under the hybrid input w, if started from the zero initial state. The definition above 
imphes that the input-output behavior of a DTLSS can be formahzed as a map 

f -M^ ^ W. (3) 

The value f{w) for w of the form ([2]) represents the output of the underlying black-box 
system at time t, if the continuous inputs {ui}\^Q and the switching sequence {qi\\^Q are 
fed to the system. 

Next, we define when a general map / of the form ([3]) is adequately described by the 
DTLSS S, i.e. when S is a realization of /. 

Definition 4 (Realization). The DTLSS is a realization of an input- output map f of 
the form ([3]), if f equals the input-output map ofTi, i.e. f = yT,- 

For the notions of observability and span-reachability of DTLSSs we refer the reader 
to [201 [23]. 

Definition 5 (Dimension). The dimension ofT,, denoted by dimE, is the dimension n of 
its state-space. 

Definition 6 (Minimality). Let f be an input-output map. Then S is a minimal real- 
ization of /, if 'E, is a realization of f , and for any DTLSS S which is a realization of f , 
dimE < dimS. 

3 Overview of realization theory 

Below we present an overview of the results on realization theory of DTLSSs along with 
the concept of Markov-parameters. For more details on the topic see [20]. In the sequel, 
S denotes a DTLSS of the form ([7]j, and f denotes an input-output map f : — > M^. 

For our purposes the most important result is the one which states that a DTLSS 
realization of / can be computed from the Markov-parameters of /. In order to present 
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this result, we need to define the Markov-paramaters of / formally. Denote Q '* = {w € 
Q* j > k}. Define the maps S"/ : ^ RP, j = 1,... ,m as fohows; for any 

V = ai . . . cTj^i G Q* with ak G Q, and for any (7, qq € Q, 

^ j f{{qo,ej){q,0)) ifv = e 
Sj [qovq) = < ^ ^ (4) 

[f{iqo,ej){ai,0)...{a\,\,0){q,0)) if \v\ > 1 

with ej E M"* is the vector with 1 as its jth entry and zero everywhere else. The collection 
of maps {Sj}JLi is called the Markov-parameters of /. 

The functions S'J, j = l,...,m can be viewed as input responses. The interpretation 
of Sj will become more clear after we define the concept of a generalized convolution 
representation. Note that the values of the Markov-parameters can be obtained from the 
values of /. 

Notation 2 (Sub-word). Consider the sequence v = qo - ■ ■ qt & , qo, ■ ■ ■ ,qt ^ Q, t ^ 0- 

For each j,k G {0, . . . ,t}, define the word Vj\j. € Q* as follows; if j > k, then Vj^f^ = e, if 
j = k, then Vjy = qj and if j < k, then Vj\f. = qjqj^i ■ ■ ■ qu- That is, Vj^f^ is the sub-word 
of V formed by the letters from the jth to the kth letter. 

Definition 7 (Convolution representation). The input-output map f has a generalized 
convolution representation (abbreviated as GCR), if for all w G of the form 
f{w) can be expressed via the Markov-parameters of f as follows. 

t-i 

k=0 

where Sf{w) = [s({w) . . . sLiw)] G for all w e Q* . 

Remark 1. // / has a GCR, then the Markov-parameters of f determine f uniquely. 

The motivation for introducing GCRs is that existence of a GCR is a necessary 
condition for realizability by DTLSSs. Moreover, if / is realizable by a DTLSS, then 
the Markov-parameters of / can be expressed as products of the matrices of its DTLSS 
realization. In order to formulate this result more precisely, we need the following notation. 

Notation 3. Consider the collection of n x n matrices A^, a £ X. For any w G Q* , 
the n X n matrix A^ is defined as follows. If w = e, then A^ is the identity matrix. If 
w = (T1CJ2 • • • cjjt G X* , ai, ■ • • ak £ X , k > 0, then 

Aw = ^o-j.^o-j._i • • • ^cri • (5) 

Lemma 1. The map f is realized by the DTLSS S if and only if f has a GCR and for 
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all V e Q* , q,qo e Q, 



SUqovq) = CqAyBq^ej, j = l,...,m. 



(6) 



Next, we define the concept of a Hankel-matrix. Similarly to the linear case, the 
entries of the Hankel-matrix are formed by the Markov parameters. For the definition of 
the Hankel-matrix of /, we will use lexicographical ordering on the set of sequences Q*. 

Remark 2 (Lexicographic ordering). Recall that Q = {!,..., D}. We define a lexico- 
graphic ordering -< on Q* as follows. For any w, s G Q* , v < s if either \v\ < \s\ or 
< \v\ = \s\, V ^ s and for some I € {1, . . . , vi < s; with the usual ordering of 
integers and Vi = Si for i = 1, . . . ,1 — 1. Here Vi and Si denote the ith letter of v and s 
respectively. Note that -< is a complete ordering and Q* = {vi,V2, ■ ■ ■} with vi ~< V2 ~< ■ ■ .. 
Note that vi = e and for a/H G N, (7 € Q, Vi -< Viq. 

In order to simplify the definition of a Hankel-matrix, we introduce the notion of a 
combined Markov-parameter. 

Definition 8 (Combined Markov-parameters). A combined Markov-parameter [v) of 
f indexed by the word v (z Q* is the following pD x Dm matrix 



Mf{v) 



Sf{lvl) 
Sf{lv2) 



, Sf{Dvl) 
, Sf{Dv2) 



Sf{lvD), Sf{DvD) 



(7) 



Definition 9 (Hankel-matrix). Consider the lexicographic ordering -< of Q* from Remark 
m Define the Hankel-matrix Hf of f as the following infinite matrix 



Mf{vivi) Mf{v2Vi) ■■■ Mf{vkVi) 
Mf{viV2) Mf{v2V2) ■■■ Mf{vkV2) 
^~ Mf{viV3) Mf{v2V3) ■■■ MJ'ivkVs) 



i. e. the pD x (mD) block of Hf in the block row i and block column j equals the combined 
Markov-parameter (vjVi) of f . The rank of Hf, denoted by rank Hf, is the dimension 
of the linear span of its columns. 

The main result on realization theory of DTLSSs can be stated as follows. 

Theorem 1 ([20]). 1. The map f has a realization by a DTLSS if and only if f has a 
GCR and rank Hf < -\-oo. 

2. A minimal DTLSS realization of f can be constructed from Hf and any minimal 
DTLSS realization of f has dimension rank Hf. 
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3. A DTLSSTi is a minimal realization of f if and only ifT, is span-reachable, observable 
and it is a realization of f . Any two DTLSSs which are minimal realizations of f 
are isomorphic^. 

Note that Theorem [T] shows that the knowledge of the Markov-parameters is nec- 
essary and sufficient for finding a state-space representation of /. In fact, similarly to 
the continuous-time case |2I], we can even show that the knowledge of finitely many 
Markov-parameters is sufficient. This will be done by formulating a realization algorithm 
for DTLSSs, which computes a DTLSSs realization of / based on finitely many Markov- 
parameters of /. 

In order to present the realization algorithm, we need the following notation. 

Notation 4. Consider the lexicographic ordering -< ofQ* and recall that Q* = {vi,V2, • • • , } 
where vi ~< V2 - - - ■ Denote by N(L) the number of sequences from Q* of length at most L. 
It then follows that \vi\ < L if and only if i < N(L). 

Definition 10 {Hf ^ M sub-matrices of Hj). For L,K € N define the integers II = 
JSS{L)pD and Jk = N{K)mD Denote by Hj i ^ the following upper-left II x Jk sub- 
matrix of Hf, 



M^{vivi) Mf{v2Vi) 
Mf{viV2) Mf {V2V2) 



M^{V-!SI(^K)V2) 



Notice that the entries of -ff/,L,/< are Markov-parameters indexed by words of length 
at most L -\- K, i.e. Hj i k is uniquely determined by {M-l" {vi)}^^~^^\ 

The promised realization algorithm is Algorithm [H which takes as input the matrix 
Hf^N,N+i and produces a DTLSS. Note that the knowledge of Hf^jy^N+i is equivalent to the 
knowledge of the finite sequence {M-^ ^^^^ of Markov-parameters. The correctness 

of Algorithm [T] is stated below. 

Theorem 2. /frank //jjv,7V = rank Hf, then Algorithm\^ returns a minimal realization 
of f . The condition rank Hj^jy^^ = rank Hf holds for a given N, if there exists a 
DTLSS realization of f such that dimS < + 1. 

The proof of Theorem [2] is completely analogous to its continuous-time counterpart |21j . 
Theorem\^ implies that if f is realizable by a DTLSS, then a minimal DTLSS realization 
of f is computable from finitely many Markov-parameters, using Algorithm [TJ In fact, if 
/ is realizable by a DTLSS of dimension n, then the first N(2n — 1) Markov-parameters 
{M'^(fj)}^*'^" '^^ uniquely determines f . 



■^see [20] for the definition of isomorphism between DTLSSs 
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Algorithm 1 

Inputs: Hankel-matrix ^^/,7v,Ar+i- 

Output: DTLSS Sjy 

1: Let n = rank Hj^n^n+i- Choose a tuple of integers (ii, . . . , in) such that the columns 
of -ffj^AT^Tv+i indexed hy ii, ... ,in form a basis of Imi?j^jv,iv+i- Let O be Itv x n matrix 
formed by these linearly independent columns, i.e. the rth column of O equals the vth 
column of -fTj^jv^Tv+i- Let R E j^^x-^iv+i matrix, rth column of which is formed 

by coordinates of the rth column of Hf ^n^nj^i with respect to the basis consisting of 
the columns ii, . . . , i„ of -ffj^Ar^Tv+i; for every r = 1, . . . , Jn+i- It then follows that 
Hf^N,N+i = OR and rank R = rank O = n. 

2: Define R G M"^"'^ as the matrix formed by the first Jat columns of R. 

3: For each q G Q, let Rg € R"^-^^ be such that for each « = !,... Jjy, the ith column 
of Rg equals the r(i)th column of R. Here r(i) G {1, . . . , Jat+i} is defined as follows. 
Consider the decomposition i = (r — l)mD + z for some z = 1, . . . ,mD and r = 
1, . . . , N(A^). Consider the word VrQ and notice that \vrq\ < + 1. Hence, Vj-q = Vd 
for some d = 1, . . . , N(A^ + 1). Then define r{i) as r{i) = {d — l)niD + z. 

4: Construct S^v of the form ([T]) such that 

[Bi,... , Bd] = 

the first mD columns of R (8) 

[Cf ... C5]^= the first rows of O (9) 

yqeQ:Ag = RgR+ (10) 

where R"*" is the Moore-Penrose pseudoinverse of R. 
5: Return Sjv 
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The intuition behind Algorithm [T] is the following. The state-space of the DTLSS S^v 
returned by Algorithm [T] is an isomorphic copy of the space spanned by the columns of 
Hf^N,N- The isomorphism is determined by the matrix R. The columns of Bq, q G Q are 
formed by the columns {q — l)mD + 1, . . . , qmD of the block-matrix 

M^ivivi)'^ ... M^iviVj^^L)? 

The rows of Cg, q G Q are formed by the rows {q — l)p + 1, . . . ,pq of ifj^7v,Ar+i- Finally, 
the matrix Ag, q G Q is the matrix of a shift-like operator, which maps a block-column 
{M-I" {vjVi)}^J^^ of i/j.7v,Ar to the block-column {M-I" {vjqvi)}^j^^ of -ff/.Ar,Af+i. 



4 Main results of the paper 

The main idea behind our definition of persistence of excitation is as follows. The measured 
time series is persistently exciting, if from this time-series we can reconstruct the Markov- 
parameters of the underlying system. Note that by Theorem [21 it is enough to reconstruct 
finitely many Markov-parameters. This also means that our definition of persistence of 
excitation is also applicable to finite time series. 

In order to present our main results, we will need some terminology. 

Definition 11 (Output time-series). For any input-output map f and for any finite input 
sequence w € we denote by 0(f,w) the output time series induced by f and w, i.e. if 
w is of the form ([2]), then 0{f,w) = {yt}f=o, such that yt = f{{qo,uo) ■ ■ ■ {qt,ut)) for all 
t < T. 

Definition 12 (Persistence of excitation). The finite sequence w S is persistently 
exciting for the input-output map /, if it is possible to determine the Markov-parameters 
of f from the data {w,0{f,w)). 

Remark 3 (Interpretation). Theorem\^ and Algorithm{l\ allow the following interpre- 
tation of persistence of excitation defined above. If w is persistently exciting, then the 
Markov-parameters of f can be computed from the response of f to the prefixes of w. In 
particular, if f admits a DTLSS realization of dimension at most n, then the Markov- 
parameters {M^ {vi)}^S^^ can be computed from the data {w,0{f,w)). The knowledge 
of {M-^ (^i)}il^i" sufficient for computing a DTLSS realization of f . Hence, persis- 

tence of excitation of w for / means that Algorithm [T] can serve as an identification al- 
gorithm for computing a DTLSS realization of / from the time-series {w,0{f,w)). Note, 
however, that our definition does not depend on AlgorithmUl Indeed, if there is any algo- 
rithm which can correctly find a DTLSS realization of f from (vu, 0(/, w)), then according 
to our definition, w is persistently exciting. Note that our definition of persistence of 
excitation involves only the inputs, but not the output response. 
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So far we have defined the persistence of excitation for finite sequences of inputs. 
Next, we define the same notion for infinite sequences of inputs. To this end, we need the 
following notation. 

Notation 5. We denote by the set of infinite sequences of hybrid inputs. That is, 
any element w G can be interpreted as a time-series w = {{qt,Ut)}^Q. For each 
€ N, denote by wn the sequence formed by the first N elements of w, i.e. wjy = 
{qo,uo) • • • {qN,UN)- 

Definition 13 (Asymptotic persistence of excitation). An infinite sequence of inputs 
w G is called asymptotically persistently exciting for the input-output map /, if the fol- 
lowing holds. For every sufficiently large N, we can compute from {wj\f,0{f,wj\f)) asymp- 
totic estimates of the Markov-parameters of f. More precisely, for N € N, we can compute 
from {w]\f,0{f,WN)) some matrices {M^{v)}veQ* such that liniN^oo M^{v) = M-f{v) for 
all V € Q* . When clear from the context, we will use the term persistently exciting instead 
of asymptotically persistently exciting. 

Remark 4 (Interpretation). The interpretation of asymptotic persistence of excitation is 
that asymptotically persistently exciting inputs allow us to estimate a DTLSS realization 
of / with arbitrary accuracy. Indeed, assume that w € is asymptotically persistently 
exciting. Then for each N we can compute from the time-series {wi\i,0{f,wj\f)) an ap- 
proximation {M^{v)}^^Q* of the Markov-parameters of f . Suppose that f is realizable 
by a DTLSS of dimension n and we know the indices (ii, . . . ,in) of those columns of 
Hf^n-i.n which form a basis of the column space of Hf^n-i,n- Let H^n^i n matrix 
which is constructed in the same way as Hf ^-i^m but with M^{v) instead of the Markov- 
parameters M^{v). Since M^{v) converges to Mf{v) for all v E Q* , we get that each 
entry of HJ^_^^ converges to the corresponding entry of H j^n-i.n- Modify AlgorithmU\by 
fixing the choice of columns to (ii, . . . ,in) in the first step. It is easy to see that the mod- 
ified algorithm represents a continuous map from the input data (finite Hankel-matrix) to 
the output data (matrices of a DTLSS). For sufficiently large N, the columns of H^^_^ ^ 
indexed by {ii, . . . , in) also represent a basis of the column space of II^^_^ ^. If we apply 
the modified AlgorithmlJ\ to the sequence of matrices H^^_^^, we obtain a sequence of 
DTLSSs Tin,N cLnd the parameters of Tin,N converge to the parameters of the DTLSS S 
which we would obtain from Algorithm\^ if we applied it to Hf n-i,n- In particular, by 
choosing a sufficiently large N , the parameters ofY,n,N sufficiently close to those ofT,. 

We will show that for every reversible DTLSS there exists some input which is per- 
sistently exciting. In addition, we present a class of inputs which are persistently exciting 
of any input-output map / realizable by a stable DTLSS. 
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4.1 Persistently exciting input for specific systems 

In this section we present results which state that for any input-output map / which is 
reahzable by a DTLSS, there exists a persistently exciting finite input. 

Note that from @ it follows that the Markov-parameters of / can be obtained from 
finitely many input-output data. However, the application of @ implies evaluating the 
response of the system for different inputs, while started from a fixed initial state. In 
order to simulate this by evaluating the response of the system to one single input (which 
is then necessarily persistently exciting), one has to provide means to reset the system to 
its initial state. In order to be able to do so, we restrict attention to reversible DTLSSs. 

Definition 14. A DTLSS of the form ([1]) is reversible, if for every discrete mode q £ Q, 
the matrix Aq is invertihle. 

Reversible DTLSSs arise naturally when sampling continuous-time systems. 

Theorem 3. Consider an input- output map f. Assume that f has a realization by a 
reversible DTLSS. Then there exists an input w € such that w is persistently exciting 
for f. 

Sketch of the proof. The main idea behind the proof of Theorem [3] is as follows. If / 
admits a DTLSS realization of dimension n, then the finite sequence {M^ of 
Markov-parameters determine all the Markov-parameters of / uniquely. Hence, in order 
for a finite input w to be persistently exciting for /, it is sufficient that {M^ {vi)}^S^^ 
can be computed from the response {w,0{f,w)). 

Note that ([3]) implies that {M-^(f j)}^^^" can be computed from the responses of 
/ from finitely many inputs. More precisely, {M^ can be computed from 
{/(s) I s G S}, where 

S = {{qo,ej){ai,0) . . . {a\^^\,0){q,0) eU+ \ qo,q^Q, 
Vi = ai. . .o-|^^|, j = 1, . . . ,m,i = 1, . . . ,N(2n - 1)}. 

Hence, if for each s G S there exists a prefix p oi w such that f{s) = f{p), then this w will 
be persistently exciting. 

One way to construct such a tt; is to construct for each s G 5 an input s~^ € such 
that 

yvel(+ : f{ss-^v) = f{v). 

That is, the input s~^ neutralizes the effect of the input s. We defer the construction of 
the input s~^ to the end of the proof. Assume for the moment being that such inputs 
s~^ exist. Let S = {si, . . . , Sd} be an enumeration of S. Then it is easy to see that 
f{siSi^S2) = /(s2), fisis^'^. $282^83) = /(ss), etc. Hence, if we define 

W = 818^'^ ■ ■ ■ 8d-l8'j^\8d, 
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then each f{s), s & S can be obtained as a response of / to a suitable prefix of w. Hence, 
w is persistently exciting. 

It is left to show that exists. Consider a reversible realization S of /. Then the 
controllable set and reachable set of S coincide by [7J. Hence, from any reachable state x of 
S, there exists an input w{x) such that w{x) drives S from x to zero, i.e. xy,{x, w{x)) = 0. 
For each s £ S, let x{s) = xe(0, s) and define s"^ = 'w{x{s)) as the input which drives 
x{s) back to the initial zero state. □ 

It is easy to see that Theorem [3] can be extended to any input-output map which 
admits a controllable DTLSS realization. However, it is not clear if every input-output 
map which is realizable by a DTLSS is also realizable by a controllable DTLSS. Note that 
the construction of the persistently exciting w from Theorem [3] requires the knowledge of 
a DTLSS realization of /. Below we present a subclass of input-output maps, for which 
the knowledge of a state-space representation is not required to construct a persistently 
exciting input. 

Definition 15. Fix a map .^^ : U 3 a ^ a^^ £lA. A input-output map f is said to be 
reversible with respect to the map if for all a & U, s,w £ U* , \sw\ > 0, 

f{saa^^w) = f{sw). 

Intuitively, / is reversible with respect to if the effect of any input a = {q,u) 
can be neutralized by the input a~^. Such a property is not that uncommon, think for 
example of turning a valve on and off. For example, if / has a realization by a DTLSS 
S of the form ([TJ, and Q = {1, . . . , 2K} such that for each q € {1, . . . , K}, Ag = A'^^j^, 
Bq = —ABqj^Ki then / is reversible and {q,u)~^ = {q + K, —u). 
From the proof of Theorem O we obtain the following corollary. 

Theorem 4. // / is reversible with respect to then a persistently exciting input se- 
quence w can be constructed for f . The construction does not require the knowledge of a 
DTLSS state-space realization of f . If the inputs from Definition[T^ are computable 
from a, then the construction of w is effective. 

Proof of Theorem^ The proof differs from that of Theorem [3] only in the definition of s~^ 
for each s G S. More precisely, if / is reversible, then for each s = {qo,UQ) ■ ■ ■ {qt,ut) G S 
define 

s~^ = {qt,uty^{qt-i,ut-iy^ ■ ■ ■ iqo,uor^ 

□ 

4.2 Universal persistently exciting inputs 

Next, we discuss classes of inputs which are persistently exciting for all input-output maps 
realizable by DTLSSs. 
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Definition 16 (Persistence of excitation cond). An infinite input w = {{qt,ut)}'^Q € hC^ 
satisfies PE condition, if there exists a strictly positive definite m x m matrix TZ and a 
collection of strictly positive numbers {'n'v}v€Q+ such that for any positive integer j G N 
and any word v S 

1 ^ 

J™ ^ Yl ^t+jujx{mt+i ■ ■ ■ qt+\v\-i = v) = 

t=0 
1 ^ 

^™ Iv ^t~j^tX{qt~jqt~j+i ■ ■ ■ qt-j+\v\-i =v)=0 
t=j 
N 



lim T7 XI '^t'^tXiqt ■ ■ ■ qt+\v\-i = v) = TTyTl 



t=0 



where x is the indicator function, i.e. x{^) = 1 holds and x{^) = otherwise. 

Remark 5 (PE condition implies rich switching) . Note that if w G satisfies the con- 
ditions of Definition \16\ then 



N 

Af-5-oo 



lim V x{qt ■ ■ ■ qt+\v\-i =v) =TTy>0 



for each v G . This implies that any sequence of discrete modes occurs in the switch- 
ing signal. Hence, our condition for persistence of excitation implies that the switching 
signal should be rich enough. This is consistent with many of the existing definitions of 
persistence of excitation for hybrid systems. The requirement that vr^, > for all v (z Q* 
is quite a strong one. At the end of this section we will discuss possible relaxations of this 
requirement. 

Remark 6 (Relationship with stochastic processes). Fix a probability space {n,J-,P) and 
consider ergodic discrete-time stochastic processes ii^ : $7 ^ M™" and : Q Q with 
values in and Q respectively. In addition, assume the following. 

• The processes ut and are independent (i.e. the a-algebras generated by {ittj^o 
and by {g^}^Q are independent. 

• The stochastic process Ut is a colored noise, i.e. it is zero-mean, Ut and Ug are 
uncorrelated and E[utUi] = TZ > 0, with E[-] denoting the expectation operator. 

• For each v € , ir^ = P{qt ■ ■ ■ qt+\v\-i = v) > ^■ 

It then follows that almost all sample paths of ut, q^ satisfy the PE condition of Definition 
\1(A That is, there exists a set A G such that P{A) = and for all uj £ 0,\ A, the 
sequence w = {{qt,Ut) = (q^^uj), ZLt{Ljj)}^Q satisfies the PE condition. 
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Remark 7. If iLt is a white-noise Gaussian process and if the variables are uniformly 
distributed over Q (i.e. P{qt = q) = and are independent from each other and from 
{ugj^Q, then Ut and satisfy the conditions of Remark IE and hence almost any sample 
path of Ut and q^ satisfies the PE condition of Definition lifil 

This special case also provides a simple practical way to generate inputs which satisfy 
the PE conditions. 

We will show that input sequences which satisfy the conditions of Definition [16] are 
asymptotically persistently exciting for a large class of input-output maps. The main idea 
behind the theorem is as follows. Consider a DTLSS S which is realization of /, and 
suppose we feed a stochastic input {q^jU^} into S. Then the state and the output 
response of S will also be stochastic processes. Suppose that {qj,Uf} are stochastic 
processes which satisfy the conditions of Remark [6l It is easy to see that 

t 

fc=0 

and hence for all r,q ^ Q, v & Q*, \rvq\ = t + 1, 

-^[ytUo x(qo • • • = rvq)] = 

t 

CgAyBrE[ukul^x{<lo • • • q* = rvq)] = (11) 

k=0 

CqA^BrTZTTrvq = {rvq)TZ'Krvq- 

Hence, if we know the expectations -E'[y(U^x(qo ' ' ' q* = rvq)] for all r,q ^ Q, v ^ Q*, 
\rvq\ = t + 1, t > 0, then we can find all the Markov-parameters of /, by the following 
formula 

S^rvq) = E[ytU^x{^o ' ' ' ^t+i = rvq)]n-'^ . 

TTrvq 

Hence, the problem of estimating the Markov-parameters reduces to estimating the 
expectations 

E[ytUoX{(lo---q.t = rvq)]. (12) 

For practical purposes, the expectations in (I12p have to be estimated from a sample-path 
of y^, Ut and q^. The most natural way to accomplish this is to use the formula 

1 ^ 

J™ U Yl Vi+t^Jxili ■ ■ ■ Qi+t = rvq) (13) 

t=i 

where yt, ut, qt denote the value at time t of a sample-path of y^, \it and q^ respectively. 
Note that yt is in fact the output of S at time t, if the input {ui}l^Q and the switching 
signal {gi}*=o *o system. 
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The problem with estimating (|12|) by is that the hmit p3|) may fail to exist or to 
converge to (fT2l) . 

A particular case when ()13p converges to (I12p is when the process (y(,U(,q() is er- 
godic. In that case, we can choose a sample-path {yt,ut,qt) of {y^,u.t,<if) for which the 
limit in (1130 equals the expectation ()12p ; in fact 'almost all' sample paths will have this 
property. This means that we can choose a suitable deterministic input sequence {ut}'^Q 
and a switching signal {qt}'^o, such that for the resulting output {yt}^Q, the limit (fT3l) 
equals the expectation (fT^ . That is, in that case the input w = {qo,uo) • • • {qt,ut) • • • 
is asymptotically persistently exciting. However, proving ergodicity of is not easy. In 
addition, even if is ergodic, the particular choice of the deterministic input w for which 
(fT3]) equals ([H]) might depend on the DTLSS itself. 

For this reason, instead of using the concepts of ergodicity directly, we just show that 
for the input sequences w which satisfy the conditions of Definition [TBI the corresponding 
output {yt}t^o has the property that the limit (fT3l) exists and it equals {rvq)TZ7rrvq, for 
any input-output map / which is realizable by a li-stable DTLSS. This strategy allows us 
to use elementary techniques, while not compromising the practical relevance of the result. 

In order to present the main result of this section, we have to define the notion of 
/i-stability of DTLSSs. 

Definition 17 (Stability of DTLSSs). A DTLSS S of the form ([I]) is called h-stahle, if 
for every x E M", the series Ylv&Q* \\-^vx\\2 is convergent. 

Remark 8 (Sufficient condition for stability). If for all q ^ Q, \\Aq\\2 < y^, where \\Aq\\2 
is the matrix norm of Aq induced by the standard Euclidean norm, then S is li-stable. 

Remark 9 (Asymptotic stability). // S is h-stable, then it is asymptotically stable, in 
the sense that if Si G Q* , i > is a sequence of words such that lim,_!.oo \si\ = +oo, then 
limj_j.oo As-X = for all x S M". 

Intuitively it is clear why we have to restrict attention to stable systems. Recall that 

allows us to compute the Markov-parameters of / from the responses of / to finitely 
many inputs. In order to obtain the response of / to several inputs from the response of 
/ to one input, one has to find means to suppress the contribution of the current state 
of the system to future inputs. In ^4.11 this was done by feeding inputs which drive the 
system back to the initial state. Unfortunately, the choice of such inputs depended on the 
system itself. By assuming stability, we can make sure that the effect of the past state will 
asymptotically diminish in time. Hence, by waiting long enough, we can approximately 
recover the response of / to any input. 

Another intuitive explanation for assuming stability is that it is necessary for the 
stationarity, and hence ergodicity, of the output and state processes y^, xt. 

Equipped with the definitions above, we can finally state the main result of the section. 
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Theorem 5 (Main result). If w satisfies the PE conditions of Definition WR. then w is 
asymptotically persistently exciting for any input-output map f which admits a li-stahle 
DTLSS realization. 

The theorem above together with Remark [7] imply that white noise input and a binary 
noise switching signal are asymptotically persistently exciting. The proof of Theorem [5] 
relies on the following technical result. 

Theorem 6. Assume that Ti is a li-stable DTLSS of the form ([T|), and assume that w 
satisfies the PE conditions. Let {yt}tZo and {x(}^q be the output and state response ofT, 
to w, i.e. yt = yT.{wt) o,nd xt = a;s(0, wt). Then for all v, f3 G Q* , r,q & Q 

'^rvqpAyBfTZ = 

limAT^oo Eilo ^t+\v\+iufx{i, rvql3) (14) 
limTv^oo ^ E^o yt+\v\+iujx{t, rvqP) (15) 



Here we used the following notation: for all s € , 

X{t,s) = 



1 if s = qtqt+i ■ ■ ■ qt+\s\~i 
otherwise 



Informally, Theorem [6] implies that if / is realizable by a Zi-stable DTLSS, then the 
limit (fT3|) equals (fT2]) . The proof of Theorem [6] can be found in Appendix Rl 

Proof of Theorem\^ For each t, denote by yt the response of / to the first t elements of w, 
i.e. yt = fi{qo,uo) ■ ■ ■ {qt,ut)). For each integer N G N and for each word v G Q*, define 
the matrix S]\f{rvq) as 



1 ^ 

SN{rvq) = {^^yt+\v\+iulxit,rvq))n- 



1 1 



t=o 

and define the matrix Mi\i{v) by 

' Sn{IvI) ■■■ Sn{Dv1)' 

Sn{IvD) ••• Sn{DvD) 
From Theorem [6] it follows that 

lim SNirvq) = S^ {rvq) 

N^oo 

and hence liuij^^oo M]\i{v) = M-^(w). Hence, w is indeed asymptotically persistently 
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exciting. □ 

Remark 10 (Relaxation of PE condition). Assume that we restrict attention to input- 
output maps which are realizable by a li-stable DTLSS of dimension at most n, and let f 
be such an input-output map. In this case, one can replace the conditions of Definition \lb\ 
that TTy > by the condition that vTs > for all \s\ < 2n+ 1 and still obtain asymptotically 
persistently exciting inputs for f . 

Indeed, consider now any w G lA''^ which satisfies Definition\16\ with the exception that 
TT^ > is required only for \v\ < 2n + 1. Then Theorem \^ remains valid for this case 
(the proof remains literally the same) and from the proof of Theorem\^ we get that for all 
i = l,...,N(2n-l), 

1 ^ _ 1 
Sf{rviq) = lim {—^yt+\v\+lU^ x{'t,rViq))n ^ 

N^co ly TTrviq 

Hence, {M^ {vi)}^S^^ can asymptotically be estimated from [wn ,0{f ,wn)) ■ Since the 
modified Algorithmic from Remark^ determines a continuous map from {M-^(f j)}^^^" 
to the other Markov-parameters of f, w is asymptotically persistently exciting for f. 



5 Conclusions 

We defined persistence of excitation for input signals of linear switched systems. We 
showed existence of persistently exciting input sequences and we identified several classes 
of input signals which are persistently exciting. 

Future work includes finding less restrictive conditions for persistence of excitation and 
extending the obtained results to other classes of hybrid systems. 



A Technical proofs 

The proof of Theorem E] relies on the following result. 

Lemma 2. With the notation and assumptions of Theorem\^ for all v € , 

1 ^ 

t=0 

The intuition behind Lemma [2] is as follows. Each xt is a linear combination of in- 
puts uq, . . . ,ut-i. Hence, YltLo^tuf can be expressed as linear combination of terms 
F "^tLk "^t-kujxitj for some s G Q*, k = 1, . . . , N. Since each such term converges to 
as — 7- oo, intuitively their linear combination should converge to as well. Unfor- 
tunately, the number of summands of the above increases with N. In order to deal with 
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this difficulty a technique similar to the M-test for double series has to be used. The 
assumption that S is /i-stable is required for this technique to work. 

Proof of Theorem 0. We start with the proof of (1140 . The proof goes by induction on the 
length of V. 

If V = e, then 

1 ^ 

— ^xt+iujxit,r(3) = 



N 
t=o 

N 

N 



^ ^{A,,xt + Bg,ut)uJx{t, r/?) = (16) 
t=o 

1 ^ 1 ^ 

t=0 t=0 

Notice Aq^xtuJ x{^^fP) = -ArXtuJ xi^i^P) and Bqi.utujx{t,rl3) = BrUtufxit^^P)- Hence, 

N , N 



t=0 t=0 

1 ^ 1 ^ 

^-(^ Yl ^tujxit, rf3)) + Br{- Y utufxit, r(3)) 



[17) 



t=0 t=0 

From the assumptions on w it follows that 

1 ^ 

J™ Y ^tufx{t, r/3) = n-Krp 

i=0 

Hence, from the PE conditions and Lemma [2] we get that 

1 ^ 

J™ ^ Y ^t+iu^x{t, r(3) = 

N^oo iV ^ — ' 
t=0 



1 " 

MJt^^ T7 J^2;tnfx(t,r-/3))+ 

N^oo iV ^ — ^ 
t=0 

1 " 
t=0 

ArO + BrTZlTrf} = TTr/jBj-TZ, 

i.e. (mi) holds. 

Assume that (jl4p holds for all words of length at most L, and assume that v = wq, \w\ = 
L for some w (z Q* and q ^ Q. Then by the induction hypothesis and the assumptions on 
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w 

1 ^ 

Iv ^ Xt+L+2U^x{t, rwql3) 
N 



t=0 



f^oo iV ^ — ' 
t=0 

1 ^ 

+ J™ 1^ BgUt+L+iufx{t, rwq(3) 



t=0 

Finally, we prove ()15p . Notice that 

yt+\v 

and hence by applying (fT^ . 

1 ^ 

1 ^ 

J™, ]V ^ ^t+\v\+2ulx{t, rvq(3) = 

CqAyBj-TZTTrvqjB- 



Proof of Lemma [B Notice that 

N 



t=l 

N 



(18) 



□ 



5Z • • • ^qjBq^-lUj~luJx{t, V) = 

t=l j=l 

N-l N 

iY At-l ■ ■ ■ ^Qt-k+lBqt^kUt-kuJxit, V)) = 
k=l t=k 

N~l N 

YY Y "^^-^^ Yj ^t-k-iufx{t -k- l,rsv) = 

r£Q k=0 \s\=k t=k+l 
N(Af) AT 

^ ^yl^^^r ut_\y^\_iufx{t-\vi\-l,rviv). 
In the last step we used the lexicographic ordering of Q* from Remark [2l It then follows 
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that 



N 

N 



t=l 

N(7V) ^ AT 

Yl Yl ^^i-^'-^v XI '^t-\vi\-iufxit - \vi\ - l,rviv). 

r&Q i=0 t=\vi\+l 



Define 



1 ^ 

= Y '^t-\vi\-i'^tXi.t l,rviv) 

t=\Vi\ + l 

Then the statement of the lemma can be shown by showing that for all r G Q, z = 1, 2, . . ., 

N(JV) 

lim V <Ar = 0. 

N^oo ^ — ' ' 
k=0 

To this end, notice from the PE conditions that 
lim = 



1 ^ 

Ay^Br lim — V] ut-k-iujx{t - k - l,rviv) = 0. 



t=k+l 

Moreover, for a fixed N and k, we can get the following estimate 

lldi^ivlb < ||^t;i-Br||2||&i,iv||2- 

If we can show that jy||2 is bounded by a number K, then we get that 

||ai,Arl|2 < ll^ijj-Br-lb-^- 

The latter inequality is already sufficient to finish the proof. Indeed, let = \\Ay.Br\\2K 
and notice from the /i -stability assumption on the realization S that 

oo 

YdI = kY^ \\A,Br\\2 
is convergent. Hence, we get that for every e > there exists a such that 

oo 

Y Dl<e/2. 
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For every N > I^, 



II XI "^^.^ll^ = II + X "i.ivlb < 

i=l i=l «=/e+l 

/. N(JV) /, 

Xll<^ll2+ X A'<Xll<Ar||2 + e/2. 

i=l i=/e+l i=l 

Since limjv->oo at ~ ^' there exists TVg G N such that for all N > N^, ||a[^||2 < 
Define TV^ to be an integer such that iV^ > N^: and N(7Ve) > /g. Then for every N > N^, 
N{N) > N(iV,) > and 

N(iV) 

II X "i,^ll2 < Xll"i,^ll2 + ^/2 < 

i=l i=l 

In other words, liniTv^o Yl^i^'' Af = 0- 

It is left to show that H&^jvlb ^ ^ ^r some K > and for alH = 1, 2, . . ., r G Q- 

1 ^ 

||&I,JV||2< X I'^il - < 

t=\Vi\+l 

1 ^ 

t=|uiH-i 

where 1|.|1f denotes the matrix Frobenius-norm, and ||.||2 denotes the matrix norm in- 
duced by the Euclidean norm. The application of the Cauchy-Schwartz inequality to 
|^.|+iK-|«i|-i)iX(* - l^^il - ^,'rviv){ut)jf leads to 

N 

[ X i'^t-\vi\-i)iX{i - \vi\ - l,rviv){u[) 

t=\Vi\ + l 

N N 



(19) 



2-1 1/2 



< 



(20) 



t=\Vi\ + l 



t=\Vi\ 



Notice that {ut-\y^\-i)fx{t - - l,rviv) < {ut-\^^^-i)j , since xit - \vi\ - l,rviv) € [0, 1]. 
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Hence, 



Similarly, 



TV 

-\vi\- l,rviv) < 

t=\vi\+l 

N N 

< Yl K-Kl-l)f<Ew^ 

t=\vi\+l t=0 



N 



N 



t=\v,\+l t=0 

Combining these remarks with ()20p . we obtain 
1 ^ 



772 Yj i'^t-M-i)iX{t - \vi\ - l,rviv){uj)j 



t=\Vi\ + l 

N 



N N 

s(^EK)?)(iEwl 



t=0 



t=0 



(21) 



Notice that limjv_>oo 'l2t=o('^t)i ~ hence Ylt=o('^t)'i bounded from above 

by some positive number Ki. Using this fact and by substituting ()21|) into ()19p . we obtain 



Hence, if we set K = 'YlTj=i^i^j^ then then ||^[^||2 < K, which is what had to be 



shown. 



□ 
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